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Abstract 

We suggest a certain statistical interpretation for the entropy pro- 
duced in driven thermodynamic processes. The exponential function 
of half irreversible entropy re-weights the probability of the stan- 
dard Ornstein-Uhlenbeck-type thermodynamic fluctuations. (We add 
a proof of the standard Fluctuation Theorem which represents a more 
natural interpretation.) 
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In 1910 Einstein [1], paraphrasing [2] Boltzmann's lapidary formula S = 
log W, expressed the probability distribution of thermodynamic variables x 
through the entropy function S(x): 

W(x) ~ e s(x) . (1) 

This equation describes thermodynamic fluctuations in Gaussian approxima- 
tion properly. Going beyond the stationary features, the time-dependence of 
fluctuations x t can be characterized by a certain probability functional W[x] 
over complete paths {x t ; t G (—00,00)}. It turns out that, in driven ther- 
modynamic processes, this probability is related to the irreversible entropy 
Si rr [x]. Symbolically, we can write the following relationship: 

W[x] ~ W ou [x - x]e Sirr[x]/2 , (2) 

where x t is the 'driving' value of parameter x t and Wou[ z ] turns out to 
correspond to fluctuations Zt of Ornstein-Uhlenbeck type. This relationship 
offers Si rr a certain statistical interpretation, somehow resembling Einstein's 
suggestion (1) for the equilibrium entropy S(x). In this short note, Ein- 
stein's approach to the thermodynamic fluctuations is outlined and standard 
equations of time-dependent fluctuations are invoked from irreversible ther- 
modynamics. Then I give a precise form to the relationship (2) for driven 
thermodynamic processes. 

The equilibrium conditions for isolated composite thermodynamic sys- 
tems derive from the maximum entropy principle: 

S(x) = max , (3) 

where S(x) is the total entropy of the system in function of certain free 
thermodynamic parameters x [3]. If the function S(x) is maximum at x = x 
then x is the equilibrium state. For example, x may be the temperature 
T of a small (yet macroscopic) subsystem in the large isolated system of 
temperature T — x. Then, the function S(x) must be the total entropy of the 
isolated system, depending on the variation of the subsystem's temperature 
around its equilibrium value. The equilibrium value x [as well as S(x) itself] 
may vary with the deliberate alteration of the initial conditions. Surely, 
in our example the temperature T of the whole isolated system can always 
be controlled at will. For later convenience, especially in treating driven 
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thermodynamic processes, we may prefer the explicit detailed notation S(x\x) 
for S(x). Though S(x) — S(x) might qualify the lack of equilibrium, nearby 
values have no interpretation in phenomenological thermodynamics. 

They only have it in the broader context of statistical physics. In finite 
thermodynamic systems there are fluctuations around the equilibrium state 
x and their probability follows Eq. (1): 

W(x\x)dx = Ne s{x \~ x) - S ^ s) dx . (4) 

Assume, for simplicity, that there is a single free variable x. The Taylor 
expansion of the entropy function yields Gaussian fluctuations: 



W(x\x) = -jL= exp(-^(:r - xf) , (5) 

where 



1 _ d 2 S(x\x) 



In our concrete example a 2 = T 2 /C where C is the specific heat of the 
subsystem. 

We are going to regard the time-dependence of the parameter x t fluctu- 
ating around x, according to the standard irreversible thermodynamics [3]. 
The time-dependent fluctuation z t = x t — x is an Ornstein-Uhlenbeck (OU) 
stochastic process [4] of zero mean (z t ) = and of correlation 

( zt z„ )ou = o*e-*W . (7) 

The relaxation rate A of fluctuations is related to the corresponding Onsager 
kinetic constant 7 by A = 7/cr 2 . It can be shown that the probability distri- 
bution of x t — z t + x at any fixed time t is the Gaussian distribution (5) as 
it must be. For the probability of the complete fluctuation path z t , the zero 
mean and correlation (7) are equivalent with the following functional: 

Wou[z\Vz = exp(-^ [ (z 2 t + \ 2 z 2 )dt)Vz , (8) 

where a possible constant of normalization has been absorbed into the func- 
tional measure T>z. 

In order to construct and justify a relationship like (2) one needs to 
proceed to driven thermodynamic processes. In fact, we assume that we 
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are varying the parameter x with small but finite velocity. Formally, the 
parameter x becomes time-dependent. For simplicity's sake we assume that 
the coefficients a, 7 do not depend on x or, at least, that we can ignore 
their variation throughout the driven range of x t . We define the irreversible 
entropy production during the driven process as follows: 

Sirrfcl^] = J (x t -X t )dx t • (9) 

In our concrete example dS irr = {C/T 2 ){T - T)dT « dQ(T~ l - T 1 ) which 
is indeed the entropy produced randomly by the heat transfer dQ from the 
surrounding to the subsystem. By partial integration, Eq. (9) leads to an 
alternative form: 

I r 1 1 

Si rr \x\x] = - / (xt Xt)dxt H 00 ^—00) ^(^00 %oc) ■ (10) 

In relevant driven processes the entropy production is macroscopic, i.e., 
Si rr ^> 1 in fee-units, hence it is dominated by the integral term above. 
I exploit this fact to replace expression (9) by 

S irr [x\x] = J (x t -x t )dx t (11) 

which vanishes for constant x. In the sense of the guess (2), I suggest the 
following form for the probability distribution of the driven path: 

W[x\x] = N[x\W ou [x - x]e s ^ [x ^ ]/2 . (12) 

The non-trivial normalizing pre-factor is a consequence of x's time-depen- 
dence and will be derived below. Since the above distribution is a Gaussian 
functional and Sj rr \ linear functional (11) of x, we can easily calculate 

the expectation value of the irreversible entropy: 

S m \x\ = (S irr [x\x}) = // XtXtre-^-^dtdlf . (13) 

In case of moderate accelerations x Ax, this expression reduces to the 
standard irreversible entropy x 2 t dt of the phenomenological theory of 
driven processes [5]. Coming back to the normalizing factor in Eq. (12), we 
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can relate it to the mean entropy production (13): M[x\ = exp(—Si rr [x}/4). 
Hence, the ultimate form of Eq. (12) will be: 

W[x\x] = W OU [x - x ] e Sirr[x\x]/2-S irr [x]/4 _ ( M ) 

This result gives the precise meaning to our symbolic relationship (2). 
If the entropy production S irr were negligible then the thermodynamic fluc- 
tuations x t — x t would follow the OU statistics (7) like in case of a steady 
state x t = const. Even in slow irreversibly driven processes Si„. may grow 
essential and exp[S irr /2] will re-weight the probability of OU fluctuations. 
The true stochastic expectation value of an arbitrary functional F[x] can be 
expressed by the OU expectation values of the re-weighted functional: 

(F[x\) = (^F[x]e s ^ [x ^ ]/2 - s "^ ]/4 ) ou . (15) 

I can verify the plausibility of Eq. (14) for the special case of small ac- 
celerations. Let us insert Eqs. (8,11) and also Eq. (13) while ignore x in 
comparison with \x. We obtain: 

W[x\x} = W u[x-x + \- 1 x] . (16) 

Obviously, the fluctuations of the driven system are governed by the OU 
process Zt (7) in the equilibrium case when x = 0. In driven process, when 
x 7^ 0, there is only a simple change: The OU fluctuations happen around 
the retarded value of the driven parameter. The lag r is 

equal to the thermodynamic relaxation time 1/A. Consequently, the driven 
random path takes the following form: 

X t = X t -r + Z t , (17) 

where Zt is the equilibrium OU process (7). This result implies, in particular, 
the equation (x t ) = x t - T which is just the retardation effect well-known in the 
thermodynamic theory of slightly irreversible driven processes. For example, 
in case of an irreversible heating process the subsystem's average temperature 
will always be retarded by r T with respect to the controlling temperature 
T[5]. 

Finally, let us summarize the basic features of Einstein's formula (1) and 
of the present proposal (2). They characterize the quality of equilibrium in 
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static and in driven steady states, respectively. They do it in terms of ther- 
modynamic entropies while they refer to a statistical context lying outside 
both reversible and irreversible thermodynamics. Both formulae are only 
valid in the lowest non-trivial order and their correctness in higher orders is 
questionable [6]. Contrary to their limited validity, they can no doubt give 
an insight into the role of thermodynamic entropy in statistical fluctuations 
around both equilibrium or non-equilibrium states. 
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Note added. The first version of this work proposed the relationship 



the exponent was free from the funny factor 1/2. The proof was wrong, of 
course. With the factor 1/2, my statistical interpretation for S irr has become 
less attractive. I also realized that a more natural statistical interpretation 
[8] was already discovered before. The present formalism offers the following 
convenient proof of the Fluctuation Theorem. 

The true probability distribution of the slowly driven process is the Onsager- 
Machlup functional [7]: 



at fixed X-oo. Let us imagine the probability distribution of the time- reversed 
process x\ = X- t driven by the time- reversed surrounding x\ = X- t . Formally, 
we only have to change the sign of x t , yielding: 



at fixed x^oo- We can inspect that the above distributions of the true and 
the time-reversed processes, respectively, satisfy the following relationship: 



W ~ Woue 
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Observe that the r.h.s. is the irreversible entropy production iSi rr [x|a;] of the 
driven process. This leads to the so-called Fluctuation Theorem: 



The irreversible entropy turns out to be a concrete statistical measure of the 
time-reversal asymmetry. 
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